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abstract 


A new  method  U described  for  calculating  bounds  for  a special 
class  of  0-1  integer  programing  problems.  This  met  rod  includes  features 
of  both  Lagrangean  and  surrogate  relaxation  approaches.  Certain  binary 
knapsack  calculation,  carried  out  In  appropriate  combination,  together 
with  an  additivity  principle  provide  the  basis  for  computing  the  bounds. 
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Solving  a linear  programming  relaxation  of  an  integer  programming 
problem  is  a commonly  used  method  for  computing  bounds  in  branch  and 
bound  algorithms.  When  an  integer  program  Includes  a subset  of  con- 
straints with  an  exploitable  mathematical  structure,  better  bounds  may 
be  obtained  by  solving  Lagrangean  relaxations  [3,6]  or  surrogate  relaxa- 
tions [7,8,9].  The  constraints  lacking  special  structure  are  assigned 
multipliers  and  carried  into  the  objective  function  in  the  Lagrangean 
approach  or  used  to  form  a summarizing  restraint  *n  the  surrogate 
approach.  These  relaxations  may  Improve  the  efficiency  of  a branch  and 
bound  algorithm  when  specialized  algorithms  are  used  to  solve  the  relaxa- 
tions and  when  the  stronger  bounds  enhance  the  fathoming  tests.  The 
value  of  these  relaxations  over  other  relaxations  depends  in  part  on 
the  values  selected  for  the  multipliers,  and  the  determination  of  optimal 
multipliers  give  rise  to  "duality  theories"  of  mathematical  programming 
[5,9].  Although  surrogate  relaxations  are  stronger  than  Lagrangean  re- 
laxations (i.e.  yield  smaller  duality  gaps)'  they  may  also  be  more  diffi- 
cult to  solve.  In  general,  the  issue  of  strength  versus  ease  of  solution 
can  be  crucial  to  the  design  of  an  effective  algorithm. 

The  purpose  of  this  paper  is  to  describe  a new  method  for  calculating 
bounds  for  a special  class  of  0-1  Integer  programming  problems.  This 
method  has  features  of  both  the  Lagrangean  and  surrograte  approaches. 
Certain  binary  knapsack  calculations  carried  out  in  appropriate  combina- 
tions together  with  an  additivity  principle  provide  the  basis  for  com- 
puting the  bound.  Our  development  is  strongly  motivated  by  the  "augmented" 
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bounding  construct  proposed  by  Ross  and  Soland  in  their  algorithm  for 
the  generalized  assignment  problem  [10].  In  that  algorithm,  bounds 
are  computed  by  calculating  an  Initial  bound  from  a relaxation  and 
augment  I ng  this  with  penalties  computed  from  the  solution  to  binary 
knapsack  problems.  These  penalties  may  be  developed  in  the  framework 
of  Lagrangean  relaxation,  but  the  extension  proposed  here,  which  also 
makes  use  of  surrogate  analyses,  gives  stronger  penalties  for  the  more 
general  class  of  problems  we  consider.  At  the  same  time,  these  new 
penalties  can  be  computed  in  a highly  efficie.it  manner  and  may  be  used 
to  augment  the  bound  through  appropriate  binary  knapsack  calculations. 

Our  development  is  motivated  not  only  by  the  success  of  Ross  and 
Soland's  use  of  binary  knapsacks  for  accelerating  the  solution  of  gener- 
alized assignment  problems,  but  also  by  the  recent  advance  in  the  effi- 
ciency of  binary  knapsack  procedures  described  in  [2].  Consequently, 
the  method  proposed  in  this  paper  is  designed  to  take  advantage  of 
techniques  with  demonstrated  computational  attractiveness,  as  well  as  to 
solve  problems  of  substantially  greater  scope  than  those  previously  shown 
to  be  amenable  to  the  "augmented"  bounding  construct. 
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j A new  method  is  described  for  calculating  bounds  for  a special 

class  of  0-1  integer  programming  problems.  This  method  includes 
[ features  of  both  Lagrangean  and  surrogate  relaxation  approaches. 

[ Certain  binary  knapsack  calculations  carried  out  in  appropriate 

| combinations  together  with  an  additivity  principle  provide  the  basis 

f for  computing  the  bounds. 
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I.  Notation  and  Problem  hefinltion 

Thv*  class  of  problems  discussed  in  this  paper  has  the  following 
mathematical  structure: 
minimize:  2 ■ 

subject  to 


z 

Je  J 

d.x. 
J J 

(2.1) 

z 

j e J 

aijXj  ' 

A! 

for  all  i t 1 

(2.2) 

z 

jc\ 

Vi : 

Bk 

for  all  kr  K 

(2.3) 

z 

j£sh 

> 

chjxj  ' 

Ch 

for  all  h e H 

(2.4) 

0 - X. 
J 

: i 

for  all  j e J 

(2.5) 

x. 

J 

integer  for  all  j e J 

(2.6) 

where  R,  A R.  ■ 0 for  k.,k.  e K and  k.  + k- 
kj  k^  12  12 

Sh  A Sh  - 0 for  hj,h2  e H and  h^  + hj 

In  addition,  the  coefficients  of  (2.3)  and  (2 . *0  must  satisfy  a sign 
assumption: 

For  any  k t K,  he  H such  that  A **  0, 

either  b.  .c,  . > 0 for  a I I j e R AS 
kj  hj  k h 

or  b.  .c.  . < 0 for  all  je  R,  A S.  . 

kj  hj  J k h 


- i*  - 


In  general,  the  sign  assumption  is  satisfied  as  long  as  the  co- 
efficients associated  with  any  set  are  all  the  same  sign  (either 
all  positive  or  all  negative  with  zero  coefficients  excluded  by  restrict- 
ing the  membership  of  the  sets  R^)  and  the  same  is  true  for  the  coefficients 

c in  any  S . As  a practical  matter,  such  conditions  are  common  in  re- 
hj  h 

source  allocation  problems.  Other  more  complex  sign  conditions  are  also 

compatible  with  the  sign  assumption. 

For  notational  convenience,  it  is  assumed  ihat  . U S,  C R . 

’ h e H h k t K k 

If  this  assumption  does  not  hold,  a redundant  constraint  of  the  form 


E 5.X.  - Se  may  be  added.  In  this  constraint,  each  fi.  is  chosen 


JCM  j j 


J 


to  be  either  +1  or  -1  to  satisfy  the  sign  assumption,  equals  the  sum  of 
the  negative  6^  and  M = {j  | j e for  some  hcH  and  j / for  all  k r.  «)• 
The  model  (2.l)-(2.6)  encompasses  a number  of  important  special  cases 
of  the  distribution-assignment  type.  In  particular,  the  generalized  as- 
signment problem  arises  when  I * 0,  all  b^  = 1,  all  = 1,  each  con- 
straint (2.3)  is  an  equality,  all  ch^  and  are  negative  and  there  is 
exactly  one  index  j in  each  intersection  5^.  More  importantly, 

generalized  transportation  ano  assignment  problems  with  additional  side 
conditions,  including  certain  mu  1 1 i -commod i ty  distribution  problems,  may 
be  represented  in  this  format. 
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2.  Calculating  a Lower  Bound 

To  provide  insight  into  our  method  for  computing  a lower  bound  for 
(2.1)  - (2.6),  an  interpretation  of  the  bounding  procedure  proposed  by 
Ross  and  Soland  [10]  in  terms  of  Lagrangean  relaxation  is  presented 


first. 


Corresponding  to  the  general  Integer  programming  problem: 
minimize  Cx 
subject  to  A x - b 
B x - a 
x - 0 


x integer 

the  lagrangcan  Relaxation  of  (P)  can  be  defined  [3,6]  relative  to  A x - b 
and  a non  negative  vecior  A to  be 


(PV 


minimize  Cx  + A (b-Ax) 
subject  tc  Bx  - d 


x - 0 


x integer 

An  equivalent  form  of  the  objective  function  of  (PR^)  is  minimize  b + 
C - *A)  x.  This  alternate  form  has  a special  interpretation  when  * Is 
chosen  as  a vector  of  optima)  dual  multipliers  associated  with  the  con- 
straints Ax  - b in  the  relaxation 
(PR)  minimize  cx 


subject  to  Ax  - b 


x - 0. 


Clearly  the  optimal  solution  to  (PR)  is  a (possiblv  weak)  lower  bound  on 
the  optimal  value  for  (P) , and  its  value  is  given  by  Xb  duality), 
ihe  relative  cost  factors  of  (PR)  are  given  by  the  vector  (c  -X  A).  In 
general,  one  would  expect  that  some  of  the  constraints  B x - d would  not 
be  satisfied  by  the  optimal  solution  to  (PR).  Thus,  in  this  case,  the 
Lagrangean  relaxation  may  be  interpreted  as  a problem  of  identifying  the 
least  costly  modi f icat iors  in  the  linear  programming  solution  necessary 
to  solve  (P) . That  is,  each  relative  cost  factor  c^  - XA^  may  be  inter- 
preted as  a penalty  that  accompanies  changes  in  the  value  of  x^.  . The 
optimal  value  of  (PR^)  consists  of  a linear  programming  bound  together 
with  an  accumulated  penalty  reflecting  necessary  changes  in  the  linear 
programming  solution.  Using  such  an  approach  to  determine  a Lagrangean 
bound  has  particular  appeal,  whenever  (PR)  has  a special  mathematical 
structure . 

The  method  just  described  for  computing  a bound  features  three  im- 
portant steps  that  :iust  be  performed.  First,  a linear  relaxation  that 
ignores  some  constraints  must  be  solved.  Second,  using  post  optimality 
information,  penalties  associated  with  making  changes  in  individual 
variable  values  must  be  determined.  Finally,  an  aggreg  . • penalty  re- 
flecting the  composite  changes  necessary  to  satisfy  the  previously  ignored 
constraints  must  be  computed  to  add  to  the  linear  relaxation  bound.  When 
applied  to  the  problem  (2.l)-(2.6)  these  three  steps  can  provide  a strong 
bound  provideJ  the  structure  of  the  problem  is  exploited  fully. 
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The  initial  step  of  our  procedure  is  to  solve  the  linear  program 
given  by  (2.1)  (2.2)  (2.3)  and  (2.5).  Given  the  optimal  dual  variables, 
w.iV,  associated  with  the  constraints  (2.2),  a partial  Layrangean  relaxa- 
tion can  be  formed  with  the  constraints  (2.2)  in  the  objective  function. 
This  relaxation  has  the  form: 


minimize 


subject  to 


• , d.w.  +d 

j cJ  J j ° 

E b.  . x . - B,  for  all  kc  K 

j£«k  J k 


(3-D 

(2.3) 


< «.- 

o-  x.  - 1 for  all  i'J 
J 


(2.5) 


where 


d . = d . - . . w*  a . . 

J J i c I , lj 


d * . w.  A. 

o i e I i i 


This  new  problem  consists  simply  of  a collection  of  separable  continuous 


knapsack  problems  each  of  the  form 


minimi ze 


(3-2) 


subject  to 


b,  . x , - B 
kj  j k 


(3 


o - x.  - 1 for  a I I j r.  R 
J k 


(3-M 


The  problems  (3-2)  (3-3)  (3-^)  are  easily  solved  by  standard  techni- 
ques. It  may  be  assumed  that  all  b^  > o (substituting  the  variable  xj='_xj 

if  b < o to  achieve  positivity).  The  variables  are  then  ordered  in  terms 
kj 

of  ascendinq  values  of  the  ratio  d./b.  .,  and  the  *.  are  assigned  values  by 
a J kj  j 

reference  to  their  position  in  the  ordering  in  the  customary  manner.  If 


some  d <o,  the  associated  variables  x.  is  set  equal  to  I and  remaining  x- 
J J J 
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assigned  values  until  (3*3)  is  satisfied.  From  duality  theory,  the  opti- 
mal values  for  the  variables  in  the  knapsack  problems  (3-2)  (3-3)  (3.*0, 
denoted  , substituted  in  either  (3.1)  or  (2.1)  give  thr  same  value. 

That  is,  if  2*  denotes  the  optimal  value  of  the  objective  function  frr 
the  problem  (2.1)  (2.2)  (2.3)  (2.5)  then 


£ d . X*  = >:  d . x . + d_ . 


The  solution  x.*  gives,  therefore,  a valid  lower  bound  2:V  on  the  optimal 
value  for  2 in  the  integer  program  (2.1)-(2.6).  Except  for  trivial  prob- 
lems, the  values  x.*  will  not  satisfy  some  of  the  constraints  (2.k)  and 
(2.6),  arid  as  indicated  earlier,  this  fact  may  be  used  to  revise  the 
bound. 

In  order  to  obtain  a solution  that  satisfies  (2.M  and  (2.6),  some 

changes  must  be  made  in  the  values  of  X^*.  Making  these  changes  will  in 

turn  increase  the  value  of  2*  to  better  reflect  the  value  of  2 in  the 

problem  (2. I)- (2.6) . The  next  steps  in  computing  the  revised  bound  are, 

therefore,  to  identify  changes  that  decrease  infeasibility  and  to  ascertain 

tne  penalty  associated  with  each  such  change. 

For  notational  convenience,  let  H1  ;{hr  H ! E c,.x.  < Ci)anc*  for 

+ , jeSh  hjj  h 

each  he  H'  let  S,  ={.e  S,  I c,.<  o and  x.  > 1}  and  let  S-  {j  e S,|  c,  .<  o 

h j h 1 hj  j h J h hj 

and  x*  > o}.  The  set  S+  (S-  ) comprises  those  variables  that  decrease  in- 
j h n 

feasibility  in  the  constraints  (2.6)  when  they  themselves  are  increased  to  1 
(decreased  to  0).  More  importantly,  the  collection  of  modified  solutions 
that  would  satisfy  any  single  constraint  h r H 1 is  given  by  the  set  of 
feasible  solutions  to  the  constraints: 


c'x.  + 


j e K hi  J J c 


Xj  = 0 or  I 


. (1-x.)  - C' 


(3-5) 


(3.6) 


P>  ' M 1 1 H 
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where  = Ch 


j ' 


and 


'hj 


c..x* 
6j  J 


( 1 -xv)  c,  . for  j i S£ 
J hj  h 


-x*  c,  . for  j c Sr  . 
J hj  h 


For  the  purpose  of  determining  a lower  bound  on  the  optimal  solution 
to  (2.l)-(2.6),  we  are  particularly  interested  in  finding  a solution  to 
(3-5)  and  (3.6)  that  optimizes  the  objective  function 


minimize  Z.  = . £ Cl  g.x.  + . ^ _ p.  (l-x.) 

h J c Sjtj  'j  j J£  j j 


(3.7) 


That  is,  we  seek  to  identify  the  least  costly  modified  solution  to  (3-2) 

(3-3)  (3.  A)  which  satisfies  (2. A)  and  (2.6),  where  q^  denotes  in  increase 

in  Z*  associated  with  enforcing  x.  = 1 and  p.  denotes  the  increase  in  Z* 

J J 

associated  with  enforcing  x.  = 0.  The  penalties  p.  and  q.  can  be  computed 

J J J 

easily  using  a naive  post-optimality  calculation  on  (3-2)  (3-3)  and  (3-A) 

that  will  subsequently  be  illustrated  by  example. 

The  result  that  establishes  the  value  of  solving  binary  knapsack 

problems  of  the  form  (3-7)  subject  to  (3-5)  and  (3-6)  is  the  following: 

Theorem  - If  Z*  denote  the  optimal  value  of  (3-7)  subject  to  (3-5)and 
h 


(3-6)  , then 


Z*  + 


h ’ H ' 


is  a valid  lower  bound  on  the  optimum  objective  function  value 
to  the  problem  (2.1)— (2.6). 

The  theorem  will  establish  that  the  penalties  | ^ and  q^  are  additive  under 
the  sign  assumption.  Thus  an  aggregate  penalty  can  be  determined  to  re- 
flect the  minimal  cost  of  making  changes  necessary  to  satisfy  (2. A)  and 
(2.6)  which  were  ignored  in  finding  the  optimal  solution  to  the  relaxation 
(2.1),  (2.2),  (2.3)  and  (2.5). 
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Before  proving  the  theorem,  an  example  will  be  given  of  the  method 

for  determining  p . and  q . tha  t will  clarify  the i r nature  and  illustrate 
J J 

conditions  that  need  to  be  established  in  order  to  demonstrate  the  va- 
lidity of  the  theorem.  Consider  the  continuous  knapsack  problem 
minimize  -9*|  + 30x^  + 20x^  + 50x^  + 45x,. 

subject  to  20X|  + 30x^  + 10x^  + 20x^  + 1 5x^  - 55 

0 - x - I , j = l ,2, . . . ,5 


which  has  the  form  of  the  knapsack  problem  (3- 2) - (3.  4)  . All  b > 0,  and 
the  variables  are  arranged  by  ascending  value  of  the  ratio  of  the  objective 
function  coefficient  to  the  constraint  coefficient.  The  optimal  solution 

A A X A A _ 

is  x = x„  = 1,  X.  = 1/2,  x,  * x.  = 0.  By  the  definitions  of  S,  and  S,  , 

I l ) 4 5 h h 

p.  values  are  needed  for  at  most  the  first  three  variables,  and  q.  values 
J J 

are  needed  for  at  most  the  last  three  variables.  Each  penalty  is  simply 
the  change  that  occurs  in  the  optimal  value  of  the  objective  function  when 
the  variable  is  forced  to  0 or  to  1 as  required.  The  following  calcula- 


tions illustrate  the  post  optimality  determination  of  these  penalties. 

P,  = -(-9)  + 1/2(20)+  3/4(50)  = 56  1/2 

0 = -20  + 1/2(10)  + 3/4(20) 

P2  = -30  + 1/2(20)  + 1(50)  + 1/3(45)  = 45 

0 = -30  + 1/2(10)  + 1(20)  + 1/3(15) 

P3  = -1/2 (20)  + 1/4(50)  = 2 1/2 

0 « -1/2(10)  + 1/4(20) 

q3  = 1/2(20)  - 1/6(30)  = 5 

0 = 1/2(10)  - 1/6(30) 

= 50  - 1/2(20)  - 1/2(30)  = 25 

0 = 20  - 1/2(10)  - 1/2(30) 

qf  = 45  - 1/2(20)  - 1/3(30)  = 25 

0 = 15  - 1/2(10)  - 1/3(30) 


tl 


It  should  be  noted  that  the  foregoing  penalties  for  setting  variables 
to  0 and  I are  not  independently  additive.  That  is,  the  effect  of  summing 
several  such  penalties  may  not  give  a valid  penalty  for  the  corresponding 
assignment  of  values  to  the  variables.  To  illustrate,  the  penalty  for 
setting  x^=  0 and  x^  - 1 is  A5  whereas  the  sum  of  p ^ and  q^  is  70.  Never- 
theless, it  is  desirable  to  use  the  foregoing  "knapsack  panalties"  in  some 
fashion  because  they  are  stronger  than  the  corresponding  Lagrangean  penal- 
ties (which  are  respectively  1*9,  30,  0,  0,  10  and  15  for  p^  .p^p^.q^q^ 

2 

and  q^).  The  following  observation  lays  a foundation  for  using  the 
knapsack  penalties. 

Lemma : The  p^  and  q^  penalties  for  a knapsack  problem  with  all  b^>  0 

are  additive  as  long  as  they  are  not  mixed  (i.e.,  as  long  as  a 
given  sum  contains  only  one  of  these  two  types  but  not  the  other). 
Proof : The  lemma  follows  immediately  by  considering  the  form  of  the  cal- 

culation that  gives  a valid  penalty  for  simultaneously  setting 

more  than  one  x.  to  0 or  setting  more  than  x.to  1.  A sequential 
J J 

assignment  of  such  values  yields  a piecewise  linear  concave  func- 
tion. 

This  lemma  is  significant  because  when  addition  is  permissible  it 
increases  the  differential  between  the  knapsack  penalties  and  the  Langranean 
penalties.  (in  fact,  it  is  easy  to  see  that  any  given  p^.  or  will  always 
dominate  the  corresponding  Lagrangean  penalty  since  the  latter  involves  a 
single  ratio  calculation  whereas  the  former  can  involve  several  ratios  each 
progressively  more  costly.)  The  more  terms  that  appear  in  a legitimate  sum, 
the  greater  the  difference  between  the  two  types  of  penalties.  This  is  not 
meant  to  minimize  the  value  of  the  Lagrangean  penalties  in  the  context  of 
the  theorem  which  are  also  valid  in  this  application. 


m 
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The  difficulty  in  using  the  foregoing  Lemma  to  take  advantage  of 

the  knapsack  penalties  In  a more  general  context  relates  to  the  signs  of 

coefficients  b,  ..  In  particular,  if  some  b,  . in  (3-3)  are  negative, 
kj  kj 

necessitating  a transformation  to  achieve  positivity,  then  a p^  for  a 

transformed  variable  will  not  necessarily  be  additive  with  a p.  associated 

J 

with  a variable  which  was  not  transformed.  That  is,  for  a variable  with 
b^j  <0,  the  pj  will  have  been  computed  as  q^.  and  vice  versa.  However, 
under  the  sign  assumption  such  potential  conflicts  are  resolved  as  we 
now  show. 

Proof  of  the  Theorem: 

Penalties  associated  with  any  two  variables  jj,  e such  that 
j l e Rk  » j 2 e ^k  an<*  S ^ **2  are  *utomaticly  additive  because  of  the 
separability  of  the  problems  (3-2)-(3.*0  . Thus,  in  order  to  invoke  the 


Lemma,  we  must  show  that  for  all  j e R^,  the  penalties  and  in 

(3.5)  are  of  the  same  type  in  the  sense  of  the  Lemma. 

The  condition  b.  .c.  . >0  for  all  j e S.  H R.  assures  that  for  j e S* 
kj  hj  h l>  h 

b,  . > 0 and  for  j e S.  , b.  . < 0.  Thus  a penalty  p.  incurred  when  x*  is  set 
kj  h kj  J J 

equal  to  0 given  that  b,.<  0 is  of  the  q.  type  for  a knapsack  problem 

KJ  J 

with  all  b.  .>0.  Similarly,  the  condi  tion  b.  . c.  . <0  for  all  jeSfh  R. 

kj  kjhj  h k 

assures  that  for  j e S*,  b^  <0  and  for  j'c  S^,  b^  >0.  Thus  a penalty 

A 

q^.  incurred  when  Xj  is  set  equal  to  I given  that  b^j  < 0 is  of  the 

type  for  a knapsack  problem  with  all  b,  > 0.  Thus,  the  Lemma  applies  to 

KJ 

(3-7)  and  the  penalties  p^  and  q^  of  (3-7)  are  acceptably  additive. 
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Next  we  show  that  for  any  set  of  additive  (non-negative)  penalties,  the 

y A 

sum  2 is  a valid  increment  to  Z1'*  and  thus  yields  a hjund  on  th; 

h t H ' h 

optimal  integer  solution  to  (2.l)-(2.6).  Since  for  any  hcHJ  the  constraint 

(2.4)  is  not  satisfied  by  x.  it  follows  that  some  subset  of  the  x.  for  j c S* 

J J h 

* - 

must  be  set  equal  to  J and/or  some  x.  for  j c must  be  set  to  0.  Moreover, 

ft 

since  the  penalties  for  changing  the  x^  values  are  non-negative,  ti  ? total 
cost  of  such  changes  cannot  be  less  than  the  optimal  value  of  (3*7)  which 
is  the  least  cost  assignment  that  permits  (2.3)  to  be  satisfied,  leaving 

A A . A 

other  x.  unchanged.  Thus  each  Z^  is  a valid  increment  to  Z , and  the  fact 

£ 

that  the  sets  S,  are  disjoint  assures  that  the  sum  , ...  Z*  is  a valid 

h he  H*  h 

increment  for  Z*.  This  completes  the  proof. 

3,  Considerations  in  Implementation 

The  second  half  of  the  proof  of  the  theorem  shows  that  other  additive 
penalties  may  be  used  in  place  of  the  knapsack  penalties.  Furthermore, 
it  may  be  observed  that  for  penalties  p^.  and  q^.  that  have  a piecewise  con- 
cave interaction,  the  knapsack  problem  (3-5)~(3-7)  can  be  expanded  to  in- 
clude 0-1  variables  and  constraints  reflecting  these  interactions.  For 
example,  if  puv  is  a lower  bound  on  the  penalty  for  setting  both  x^  and  x^ 

equal  to  0,  then  we  may  introduce  a 0-1  variable  x wi  th  a coefficient  p 

uv  uv 

(p  + p ) in  (3-7)  and  a constraint  X - x + x -I.  Such  techniques  for 

U U UV  U V 

handling  interactions  are  easily  genera  I i zable , but  they  may  not  be  extremely 


useful  since  they  destroy  the  convenient  knapsack  structure. 


- Ill  - 

It  may  be  noted  that  problems  containing  imbedded  networks  and  re- 
lated special  structures  generally  contain  a set  of  constraints  (2.3) 
with  all  b^.  equal  to  +1  or  -I.  The  knapsack  penalty  calculations 
simplify  substantially  for  such  constiaints,  and  in  addition,  the  solu- 

A 

tions  Xj  are  integer  valued.  The  findings  of  [4]  suggest  that  there  may 
be  some  virtue  in  this  latter  condition.  One  approach  to  take  greater 


advantage  of  the  continuous  knapsack  problems  (3.2)-(3.4),  when  some 
Xj  values  are  fractional  is  by  employing  several  iterations  of  a cutting 
plane  approach,  continuing  as  long  as  worthwhile  progress  is  made.  Upon 

•3 

termination,  the  constraint  (3-3)  may  be  replaced  by  a surrogate  constraint 
generated  from  the  dual  multipliers  of  the  original  (3-3)  and  the  currently 
binding  cutting  planes  to  give  a mw  constraint  ( 3 • 3 ' ) - If  the  cutting 
plane  approach  succeeds  in  obtaining  an  integer  solution,  the  resulting 
continuous  knapsack  will  admit  this  same  solution  as  optimal  thereby  giv- 
ing an  improved  value  for  2*.  The  validity  of  replacing  (3-3)  by  (3.3') 
is  assured  by  the  following  observation. 

Remark : if  the  constraint  (3-3)  satisfies  the  sign  assumption,  the 

constraint  ( 3 - 3 1 ) will  also  satisfy  this  assumption  upon  drop- 
ping any  j from  R^  for  which  b^  becomes  0. 

Proof:  Suppose  all  b '0  in  (3- 3)-  If  the  remark  were  false,  some 
k J 

b1,  . would  be  neqative.  This  implies  that  whereas  x.  = 1 would 
kj  J 

assist  the  satisfaction  of  (3-3)  it  would  hinder  the  satisfaction 


of  (3-3') . No  standard  cutting  plane  produces  such  a contrary 
coefficient  condition  which  could  only  be  valid  if  superfluous. 


. irw«*  ^-Wiitwi, 
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It  may  also  be  observed  that  every  Index  j in  (3-3)  will  appear  in 

( 3 - 3 ' ) if  (3. 3)  has  a non-zero  weight  in  forming  the  surrogate  constraint 

( 3 - 3 ' ) • There  is,  however,  no  disadvantage  in  droppinq  some  j from  R . 

Our  remarks  on  this  point  also  have  a bearing  on  the  general  case  in 

which  S,  ^ . U u R.  . Whenever  a coef  f i c ient  b.  . (or  b ' ) is  equa  I 

hcHhkcKk  kj  k j 

to  0 (and  j may  be  removed  from  R^) , the  calculation  of  knapsack  penalties 
for  Xj  independent  of  the  problem  (3.2)-(3-M.  For  any  such  j,  there  are 
two  relevant  cases: 

p.  * -d 1 and  x*  ■ 1 if  d.<  0. 

J J J J 

q.  * d.  and  x*  ■ 0 if  d.>  0. 

J J J J 

( I f d * 0 xj  may  be  set  equal  to  0 or  I and  j may  be  excluded  from  the 
sets  S£  and  Sjj  .)  Thus,  when  the  knapsack  calculation  is  irrelevant  for 
some  variables,  the  calculation  of  the  p^  and  q^.  penalties  corresponds  to 
standard  Lagrangean  relexatlon  methods.  Further,  when  the  optimal  dual 
multiplier,  w*,  associate.:  with  a constraint  (2.3)  is  equal  to  0,  indicat- 
ing the  constraint  is  non-binding  in  the  linear  program  (2.1)  (2.2)  (2.3) 
(2.5),  the  knapsack  calculation  may  be  irrelevant.  In  this  case,  the  fore- 
going rule  would  be  more  efficient  than  setting  up  the  knapsack  problem. 

The  dual  multiplier  values  of  the  linear  program  (2.1)  (2.2)  (2.3) 
and  (2.5)  make  it  clear  how  to  utilize  constraints  (2.3)  that  are  in 
equality  form.  If  either  of  the  two  inequalities  that  compose  the  equa- 
tion has  implicitly  a non-zero  dual  multiplier,  then  that  inequality  car. 
be  used  as  (3. 3) • 
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4.  Extensions  to  More  General  Problems 

The  proof  of  '.he  theorem  lo  section  3 does  not  rest  on  the  require- 
ments that  the  constraints  (2.**)  and  hence  (3-6)  are  single  inequa  lity 
knapsack  constraints.  The  constraints  (2.4)  may  in  fact  represent  a 
collection  of  disjoint  decomposable  matrix  inequalities.  In  this  case, 
the  sign  assumption  must  hold  in  the  same  inequality  sense  for  all  com- 
ponents of  c^j  (with  a relaxation  of  the  strict  positivity  or  strict  non- 
negativity). Thus,  the  sign  assumption  becomes  for  all  components 

c‘  of  c : 
hj  hj 

ei  ther  b,  , c'  .>  0 for  all  j e R.  A S, 
kh  hj—  k h 

or  b.  . c ' < 0 for  all  j e R fl  S,  . 
kj  hj—  ».  h 

The  necessary  changes  in  other  definitions  and  statements  are  analagous. 

Systems  of  decomposable  non  negative  or  non-positive  matrix  inequali- 
ties (or  equations)  may  satisfy  the  extended  sign  assumption  when  (2.3) 
has  corresponding  non-negativity  or  non-positivity  properties.  The  appli- 
cation of  the  Theorem  to  matrix  systems  may  be  extremely  useful  if  the 
matrix  constraints  have  special  structure  that  facilitates  their  solution 
as  0-1  integer  programs.  On  the  other  hand,  if  it  is  difficult  to  obtain 
an  integer  solution  to  (3-5)  (3-6)  (3.7)  an  alternative  is  to  use  a few 
interactions  of  a cutting  plane  procedure  to  obtain  a lower  bound  on  Z*. 

Surrogate  constraints  can  again  be  used  to  transform  more  general 
structures  into  the  structure  discussed  in  preceeding  sections.  If,  for 
example,  (2.3)  is  a system  of  matrix  inequalities  (with  the  b^  represent- 
ing column  vectors)  then  the  penalty  calculations  can  be  applied  to  a 


I 
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surrogate  for  these  inequalities.  The  surrogate  constraint  can  be 
generated  from  the  dual  multipliers  of  the  linear  program  (2.1)  (2.2) 
(2.3)  (2.5)  or  by  alternative  methods.  The  sign  assumption  stated  in 
the  natural  way  for  a matrix  system  (2.3)  carries  over  to  the  surrogate 
constraints,  and  tne  remarks  concerning  (2.3)  in  its  initial  form  are 
applicable  to  the  surrogate.  This  use  of  surrogate  constraints  to  accomo 
date  more  general  forms  of  (2.3)  is  essential  because  the  additivity 
principle  identified  in  the  Lemma  does  not  manifest  itself  in  analagous 


calculations  for  matrices. 
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A certain  subclass  of  surrogate  relaxations  in  which  the 
integer  restriction  is  disregarded  or  made  irrelevant  is 
actually  equivalent  to  a form  of  Lagrangean,  relaxation, 
as  noted  in  C6 ,9]. 


For  a continuous  knapsack  problem  of  the  form 
minimize 


n 

E Vi 

j“l  J J 


subject  fo 


? -/j 


i-l 


0±-  X < 1 

the  Lagrangean  penalty  associated  with  making  a change  in 
the  optimal  value  of  any  variable  x^  is  v^-Aw^  where  X * vr^wr 

and  r is  the  least  integer  such  that  £ w > w.  Thus  the 

1*1  ^ 

Lagrangean  penalties  are  simply  the  J reduced  cost  factors  of 
the  continuous  knapsack  problem.  It  is  possible,  with  an 
additional  bit  of  circumlocation , to  view  the  stronger  knap- 
sack penalties  proposed  in  ClOj  as  "deferred"  or  "conditional" 
Lagrangean  penalties.  Independently  of  these  taxonomic  contrivances 
the  key  principle  governing  the  stronger  penalties,  as  expressed 
in  the  Lemma,  is  the  source  of  their  value  in  the  present  setting. 


We  rema'k  that  this  form  of  surrogate  constraint  is  one  of 
class  originally  proposed  in  [7]  and  not  one  of  the  weaker 
type  proposed  in  [8]  , which  corresponds  to  a Lagrangean 
relaxation. 


1 1 
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